Dopamine Bonuses
نویسندگان
چکیده
Substantial data support a temporal difference (TO) model of dopamine (OA) neuron activity in which the cells provide a global error signal for reinforcement learning. However, in certain circumstances, OA activity seems anomalous under the TO model, responding to non-rewarding stimuli. We address these anomalies by suggesting that OA cells multiplex information about reward bonuses, including Sutton's exploration bonuses and Ng et al's non-distorting shaping bonuses. We interpret this additional role for OA in terms of the unconditional attentional and psychomotor effects of dopamine, having the computational role of guiding exploration.
منابع مشابه
Dopamine: generalization and bonuses
In the temporal difference model of primate dopamine neurons, their phasic activity reports a prediction error for future reward. This model is supported by a wealth of experimental data. However, in certain circumstances, the activity of the dopamine cells seems anomalous under the model, as they respond in particular ways to stimuli that are not obviously related to predictions of reward. In ...
متن کاملFactors Related to Lump Sum Bonuses: The Case of a Canadian Financial Institution
The use of lump sum bonuses as a variable pay system is increasingly popular with businesses. Used as a means to reward strong individual performances of employees, lump sum bonuses are granted according to the manager’s appraisal of the employee’s performance. The aim of this research is to ascertain whether there are factors other than individual performance that exert an influence on the gra...
متن کاملThe anatomy of choice: dopamine and decision-making
This paper considers goal-directed decision-making in terms of embodied or active inference. We associate bounded rationality with approximate Bayesian inference that optimizes a free energy bound on model evidence. Several constructs such as expected utility, exploration or novelty bonuses, softmax choice rules and optimism bias emerge as natural consequences of free energy minimization. Previ...
متن کاملProsocial Bonuses Increase Employee Satisfaction and Team Performance
In three field studies, we explore the impact of providing employees and teammates with prosocial bonuses, a novel type of bonus spent on others rather than on oneself. In Experiment 1, we show that prosocial bonuses in the form of donations to charity lead to happier and more satisfied employees at an Australian bank. In Experiments 2a and 2b, we show that prosocial bonuses in the form of expe...
متن کاملInspection Games
We examine the effectiveness of bonuses and fines in an ‘inspection game’ where an employer can learn the effort of a worker through costly inspection. Standard game theoretic analysis predicts that fines discourage shirking, whereas bonuses encourage shirking. In contrast, ownpayoff effects suggest that both fines and bonuses discourage shirking. In an experiment we find that fines are more ef...
متن کامل